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2. (Unamended) The method of claim 1, wherein the step of calculating 

comprises: 

identifying parameterized geometric primitives in the space; 

determining the elements of the primitives, wherein an element is a spatial structure 

projectable onto the image; 
mapping features of the image to the elements to form correspondences; and 
solving for an objective function that minimizes an aggregate error between features of the 

image and projections of elements onto the image. 

Please delete claims 3-12 and enter the following claims for examination: 



13. A method fd^ generating remote presentations of products in situ for a user 
comprising the steps of: 

a) prompting the user to acquire\a digital image of a space in which a product is to be 

viewed in context; 

b) accepting a product representationvrepresenting a product for which a three-dimensional 

geometric model exists or can be created; 

c) determining at least one dimension reference, wherein a dimension reference is a 

measurement of a distance in the space\orresponding to a separation of two points on 
the digital image; 

d) calculating, from the image, the at least one dimension reference and reference 

information, camera parameters for a camera in. the space from which the image was 
captured, wherein the camera parameters include\t least a camera position and a focal 
length; 

e) accepting an input of a product location, the product loc^ion being a location in the 

space where the product is to be displayed in situ; 

f) transforming the geometric model of the product based on at feast the camera position 

and the product location to form a transformed geometric model; and 
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g) combining the traAsformed geometric model and the digital image to form a modified 
image of the space\where the modified image has been modified to show the 
identified product in\situ in the image with a proper proportion and perspective. 

14. The method of claim 13, wherein the step of accepting a product 
representation comprises the steps\pf: 

prompting the user to identify a\product of interest from a set of products; 

searching a collection of product ^presentations to locate a member of the collection that 

matches the product identified Vy the user; and 
accepting the matching product representation. 

15. The method of claim 1 further comprising a step of repeating steps b), e) 
and f) for second and subsequent selected products. 

16. The method of claim 13, wherein the step of accepting a product 
representation includes a prior step of prompting the^user to acquire a three-dimensional 
geometric model for a product of interest to the user. 

17. The method of claim 13, further comprising a step of repeating step a) for 
second and subsequent images of the space and using each\>f the provided images. 

18. The method of claim 13, wherein the modified image of the space is a 
two-dimensional view of a three-dimensional geometric model, the method further comprising 
a step of moving a camera position of the modified image of the s^ace to simulate moving 
around in the space. 

19. The method of claim 13, wherein the step of prompting the user to identify 
the product from a set of products is performed using a commerce server that serves product 
models and further comprising a step of transmitting the digital image to thk commerce server. 

20. The method of claim 13, wherein the step of prompting theVser to identify 
the product from a set of products is performed using a commerce application that receives 
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product models and fu^her comprising a step of providing the digital image to the commerce 
application. 

21 . The method of claim 13, wherein the camera parameters include camera 
position, camera rotation, foca^length and center of projection. 

22. The method of^claim 13, wherein the reference information includes 
correspondences between two-dimensional image features and three-dimensional structures. 

23. The method of claim 13, wherein the step of determining the at least one 
dimension reference is a step of inputting the at least one dimension reference, wherein a 
dimension reference is a measurement of a\listance in the space corresponding to a separation 
of two points on the digital image. 

24. The method of claim 13, wherein the step of determining the at least one 
dimension reference is a step of assuming a default^scale and using the default scale to 
determine the at least one dimension reference. 

25. The method of claim 13, wherein the three-dimensional model for a product 
is a planar representation of an object and a texture map to be^applied to a surface of the object. 

26. A commerce server for generating remote presentations of products in situ 

comprising: 

product image storage for storing product representations, wherein a product 

representation is at least a product image taken of a three-dimensional product; 

means for receiving at least one digital image of a space in which aproduct is to be 
viewed in situ; 

space image storage for storing the at least one digital image of the spade; 
parameter storage for storing at least one dimension reference, wherein a dimension 

reference is a measurement of a distance in the space represented as a line segment on 

the digital image; 
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a photogrammetric modelingiengine having inputs to receive an image and geometric 
primitives mapping from trie space onto the image and having an output to output the 
camera parameters of a camera^in the space with which the image was captured; 

means for receiving an indication from a client identifying one or more product from a set 
of products from the product imagevstorage; 

inputs for receiving one or more product location, a product location being a location in 
the space where the product is to be in srt 

a visual reconstruction engine having an input tb. receive the digital image of the space 
from the space image storage, an input to receive camera parameters for the digital 
image from the photogrammetric modeling engine^ an input to receive one or more 
product representation for selected products as indicated by the means for receiving 
an indication, and an output for outputting a geometric\model of elements of the space 
including the selected products; and 

a Tenderer for rendering a combination of geometric models of the one or more product 
and the space, using a set of camera parameters common to 

27. An apparatus for generating a three-dimensional geometric model from at 
least one two-dimensional image of a three-a^nerisiSrtal space having objects therein, the 
apparatus comprising: 

a photogrammetry engine within image inpVt fjzfr accepting the at least one 

two-dimensional image and a primitives^tput for outputting primitives and 
parameters that describe geometric eleWntkof the objects in the image; and 

a solid modeler with a primitives input for inputthWpnmitives and parameters output by 
the photogrammetry engine and a model outputVor outputting the geometric model, 
wherein the solid modeler further includes means Vor modeling an object in the space 
with a primitive shape or a mathematical operation of more than one primitive shape. 

28. A method for generating presentations of products in situ, wherein an in 
situ presentation includes a composite hpage showing one or more products in a space, the 
method comprising the steps of: 
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a) inputting a sc^ne digital image of the space, wherein the scene digital image is an image 

of the space captured by an image capture device positioned in the space at a capture 
position and haWg a capture focal length; 

b) calculating, from thte image, capture parameters for the image capture device in the 

space, wherein the^apture parameters include at least a representation of the capture 
position and a representation of the capture focal length; 

c) inputting a product representation that represents a product being considered for 

placement in the space; 

e) accepting an input of a producVlocation, the product location being a location in the 

space at which the product is being considered; 

f) transforming at least one of the scene digital image and the product representation 

wherein a transformed image is an\mage transformed according to the image's 
associated capture parameters; and \ 

g) combining the scene digital image and the^roduct representation, as transformed in the 

step of transforming, to form a combined image of the space where the combined 
image shows the product in situ in the sceneNin the combined image with a proper 
proportion and perspective. 

29. The method of claim 28, wherein the product representation includes a 
texture map associated with the product. 

30. The method of claim 28, wherein the productVepresentation includes at 
least a product digital image, captured by a product image capture device positioned to capture 
a digital image of the product. 

31. The method of claim 30, wherein the product representation includes a 
capture position, capture angle of rotation and focal length. 

32. The method of claim 30, wherein the product representation includes 
product image capture parameters including at least a representation of the position of the 
product image capture device when the digital image of the product was captured. 
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33. The method o^^laim 32, wherein the product image capture parameters 
include projections of geometric elements from the product onto the product digital image. 

34. The method of claii^28, wherein the capture parameters for the image of 
the scene include projections of geometric elements from the scene onto the scene digital 
image. 

35. The method of claim 28, ^herein the capture parameters for the image of 
the scene include an angle of rotation for the image capture device in the space. 

36. The method of claim 28, wherein the step of inputting a product 
representation is preceded by the steps of: 

capturing a product digital image using the produk image capture device; and 
calculating, from the product digital image, product\image capture parameters that include 

at least a representation of the product image captjire position and a representation of 

the product image capture focal length. 

37. The method of claim 28, wherein the step of transforming results in the one 
or more transformed digital images sharing common capture parameters, the common capture 
parameters including at least a capture position. \ 

38. The method of claim 28, further comprising a stepW prompting the user to 
identify the product from a set of products for which a three-dimensional geometric model 
exists or can be created. 

39. The method of claim 28, further comprising a step of inputting at least one 
dimension reference for one or both of the scene digital image and the product representation, 
wherein a dimension reference is a measurement of a distance in space corresponding to a 
separation of two points on the digital image or representation with which the dimension 
reference is associated. 
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40. The method of claim 28, further comprising the step of repeating the step of 
combining to form a further combined image of the space and a plurality of products, where 
the further combined image shWs the plurality of products in situ in the scene with each 
product having a proper proportion and perspective. 

41 . The method ofolaim 28, wherein the step of inputting a product 
representation is followed by a step oY calculating, from the product digital image, product 
image capture parameters that include at least a representation of the product image capture 
position and a representation of the product image capture focal length. 

42. A method for generating a combined image that simulates a product being 
positioned at a location where a consumer is considering placing the product, without 
physically placing the product at the location, the^method comprising the steps of: 

a) prompting the consumer to acquire a digitaKimage of the location; 

b) generating a location representation of the location and geometric elements representing 

items at the location visible in the digital image of the location; 

c) prompting the consumer to select a product from among a plurality of products; 

d) retrieving a product representation for a selected product, wherein the product 

representation includes at least a digital image of the\product and a representation of 
the position of a product image capture device when me digital image of the product 
was captured. 

43. The method of claim 42, wherein the location representation includes 
location capture parameters of a location capture device, wherein the location capture 
parameters include at least a representation of a position of the location capture device. 

44. The method of claim 42, further comprising the steps of\^ 

e) prompting the consumer to indicate where, at the location, the product is to be 

considered; and 
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4 f) combining the location representation and the product representation after transforming 

5 at least one of the representations to form the combined image showing the product in 

6 situ with a proper proportion and perspective. 

1 45. The method of claim 4 a wherein the product representation includes at 

2 least a three-dimensional geometric model and a texture map. 

1 46. The method of claim 42, whetein the method is performed by a commerce 

2 server and a consumer computer, the method further comprising the steps of: 

3 e) sending a commerce application from the commerce server to the consumer computer; 

4 f) executing the commerce application on the consupier computer, wherein the commerce 

5 application performs steps a) and c); 

6 g) using the commerce application to model geometric \lements visible in the digital 

7 image of the location; and 

8 h) generating capture parameters for the digital image of dislocation from the geometric 

9 elements using the commerce application, the capture parameters including a capture 
1 0 location and a focal length. 

1 47. The method of claim 42, wherein the method is performed by a commerce 

2 server and a consumer computer and wherein the step of retrieving the product representations 

3 is a step of retrieving the product representations from the commerce server. 

1 48. The method of claim 42, wherein the method is performed by\a commerce 

2 server and a consumer computer and wherein the step of retrieving the product representations 

3 is a step of retrieving the product representations from a product representation served 

1 49. A method of combining a plufafity^^o-dimensional images of 

2 three-dimensional spaces into a combi^ image, comprising th^steps of: 

3 receiving the plurality of two-dimensional v im^ges^ 

4 using a photogrammetry engine to identify primitives and parameters that describe 

5 geometric elements of the objects in the pluralityW two-dimensional images; 
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6 identifying common objects common to more than one of the plurality of two-dimensional 

7 images; 

8 determining camera models such that the common objects are substantially coincident in a 

9 common image plane, ti^eb^HbrmW^ geometric model; and 
10 generating an image of thdcombined^eometric nrodel. 



1 50. The method of claim^^fmher comprising a step of using a solid modeler 

2 with a primitives input to generate a geometric model for each two-dimensional image from 

3 primitives and parameters output by the photogrammetry engine. 

1 5 1 . A commVce application for generating remote presentations of products in 

2 situ, using a client-server system, the commerce application comprising: 

3 means for receiving productVepresentations, wherein a product representation is at least a 

4 product image taken of a tl^ree-dimensional product; 

5 means for receiving a space representation comprising at least one digital image of a space 

6 in which a product is to be viewed in situ; 

7 space representation storage for storing the space representation; 

8 parameter storage for storing at least one dimension reference, wherein a dimension 

9 reference is a measurement of a distance in the space represented as a line segment on 

1 0 the digital image; 

1 1 a photogrammetric modeling engine having inputs to receive an image and geometric 

12 primitives mapping from the space onto the image and having an output to output the 

13 camera parameters of a camera in the space with which the image was captured; 

14 inputs for receiving one or more product location, a product location being a location in 

1 5 the space where the product is to be in situ; 

16 a visual reconstruction engine having an input to receive the digital image of the space 

17 from the space representation storage, an input to receivescamera parameters for the 

1 8 digital image from the photogrammetric modeling engine, an input to receive one or 

19 more product representation for selected products as indicated^by the means for 

20 receiving an indication, and an output for outputting a geometric v model of elements of 

21 the space including the selected products; and 
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22 a renderer for rendering a combination of geometric models of the one or more product 

23 and the space, using a set of camera parameters common to each. 

\ 

1 52. The commerce application of claim 51, wherein the means for receiving 

\ 

2 selected product representations Comprises: 

3 means for receiving an indication from a client identifying one or more product from a set 

4 of products; and \^ 

5 means for retrieving selected product representations from a product representation 

6 storage. 

1 53. The commerce applicatiori of claim 51 comprising: 

2 a client system including the space representation storage, the parameter storage, the 

3 photogrammetric modeling engine, the visual reconstruction engine and the Tenderer; 

4 and 

5 a server system including the product representation storage. 

1 54. The commerce application of claim 5 iv comprising: 

2 a client system including the space representation storage, the parameter storage and the 

3 renderer; and 

4 a server system including the product representation storag^ the photogrammetric 

5 modeling engine, and the visual reconstruction engine. 

1 55. The commerce application of claim 51 comprising; 

2 a client system including the space representation storage and the parameter storage; and 

3 a server system including the product representation storage, the photogrammetric 

4 modeling engine, the visual reconstruction engine and the renderer\ 

1 56. The commerce application of claim 51 comprising a server system 

2 including the space representation storage and the photogrammetric modeling enki 
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57. A method 6f generating an image of a simulated space, wherein the space is 
simulated in that it shows an object placed in a scene, where the object is a physical object and 
the scene is a physical location, the method comprising the steps of: 

acquiring one or more images of the scene, wherein the scene does not contain, at the time 
of acquisition, the object at aMesired object location in the scene; 

generating a scene representation that includes a model of an image acquisition device that 
captured at least one of the one ok more scene images acquired in the step of acquiring 
one or more images of the scene, the model including at least a representation of a 
position of the image acquisition device in a space containing the at least scene image 
when the at least one scene image was Vaptured; 

acquiring an object representation of the obje<st that is to be simulated in the scene, where 
the object representation is at least an image of the object; and 

combining the scene representation and the objec\representation to form the image of the 
simulated space. 

58. The method of claim 57, wherein the object representation includes an 
image taken from an image capture device. 

59. The method of claim 57, wherein the object representation includes a 

texture map. 

60. The method of claim 57, further comprising a stepV)f obscuring a portion of 
the scene with the object where the object representation is constrained Vuch that the 
positioning or size of the object image is dependent on the positioning or \ize of an object 
present in the scene. 

61. The method of claim 60, wherein the object representation comprises an 
object image and a geometric model where the geometric model of the object corresponds to a 
geometric model of an existing object in the scene and the simulated space is a simulation of 
the replacement of the existing object with the object represented by the object 
representation.-- 



